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Abstract 

In this paper we propose a new revenue maximizing dynamic game for allocating resources 
to strategic users. We show that for the proposed game there exists a symmetric subgame 
perfect equilibrium, which is not only unique but also Markov perfect. Furthermore, we fully 
characterize it and derive the revenue of the network's owner. 

I. Introduction 

The design of resource allocation mechanisms which guarantee the delivery of differ- 
ent services and maximize some network-wide performance criterion (e.g. the networks 
utility to its users) is an important and challenging task. The challenges come from the 
fact that the network's users may behave strategically (i.e. they may behave selfishly). If 
information were centralized, the resource allocation problem could be formulated and 
solved as a mathematical programming problem or as a dynamic programming prob- 
lem. Since information is not centralized such formulations are not possible. Recently, 
within the context of communication networks, researchers have investigated decentral- 
ized resource allocation problems under the assumption that users behave strategically. 
Within the context of wired networks, decentralized resource allocation mechanisms 
have been proposed and analyzed in IU-0 and (8]|. For a survey on the relationship 
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of mechanism design and decentralized resource allocation in communication networks 
we refer the reader to BU. 

In this paper, we introduce a new approach for allocating resources (e.g. channels) 
to strategic users which is distinctly different from all the above papers. This method 
is philosophically similar to a game called War of Attrition ( IITOl ). In game theory, 
the war of attrition is a model of aggression in which two contestants compete for a 
resource of value V by persisting while constantly accumulating costs over the time t 



that the contest lasts. The model was originally formulated by John Maynard Smith |TT| 
in the context of theoretical biology. In Smith's game two animals compete for a prize 
of common value V. As soon as one player drops out play ends and the prize is given 
to the other player. The game is in continuous time and there is a constant waiting 
cost per unit of time. In the two player complete information case, the game has a 
unique symmetric equilibrium in which players randomize over all possible dropout 
times according to an exponential distribution with mean ^ where c is the constant 
waiting cost per unit of time. 

In this work, we present a model for allocating a channel to a user among a set of 
strategic players /users which is philosophically similar to the War of Attrition with 
this difference that our model is formulated in discrete time. We, further, extend the 
game so as to include the case with re-entry option for drop out players /users. We, for 
generality, assume that the value of wining the object decreases for any user as time 
goes on (we precisely define it in Section QI]). 

The rest of the paper is organized as follows. In Section [TT] we define and explain 
the components of our proposed resource allocation game. In Section [TIT] we investigate 
the existence and uniqueness of a symmetric equilibrium of the specified game and 
characterize its desired properties. In Section [TV] we consider the game formulated in 
HI] with re-entry option for users. In Section [V] we derive the revenue of the network's 
owner. We conclude in Section 



II. Game: Set up without Re-entry Option 

Consider the following dynamic game with complete information, n strategic users 
(the set of users is denoted by N) and a channel. In each round t,t G {1, 2, 3, • • ■ }, of 
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the game user i, i = 1, 2, • • • , n, chooses /reports an action from the set of pure strategies 
S = {yes,no},s itt G S, and observes his opponents actions, Sj jt ,j ^ %■ In each round 
of the game users submit their messages simultaneously. Value of the channel for each 
user is initially equal to V and it is common knowledge among the users. When a 
user plays no, the user will be out for the rest of the game (in Section [TV] we will 
study the case with re-entry option for users who play no). The remaining number 
of users in round t of the game is denoted by n[t) (the set of remaining users in 
round t is denoted by N(t)). History of the game up to time t,t G {1, 2, 3, • • • }, which 
is common knowledge among the users, is denoted by h* = (si,s 2 ,--- , St-i), where 
$k = (si,*:, S2,ki ■ ■ ■ , Sn(t),fc) represents the strategy profile reported by the users in round 
k of the game. User i,i G N(t), wins the channel in round t of the game if and only 
if Si t t = yes, Sj )t = no, j ^ i, j E N(t). That is, user % wins the channel in round t of 
the game if and only if he is the only user, among the n(t) users, who plays yes in round t. 

We assume playing yes is costly for each user. In detail, when a user plays yes he 
pays c yes (participation cost) to the network's owner, where c yes < V, (c yes is common 
knowledge among the users). Notice that we assume "participation cost" is the only 
source of benefit for the network's owner that receives from the users. 

Remark 1. For the sake of generality, we assume the value of wining the channel for each user 
is decreasing in time and is captured by V — g(t), where g(t),g(t) > 0, is an increasing function 
in t, common knowledge among the users and, lim^oo g(t) < V — c yes . 

Assumption 1 (Tie Breaking IITOl ). We assume if in round t of the game all the (current) 
users play no, then network's owner will ask the users to resubmit their messages. 

By above specifications, we define the utility of user i,i E N(t), in round t of the 
game, as follows: 



= yes) = V - g(t) - c^A* -1 + 1) if s i>t = yes, s jjt = no, j ^ z, j G N(t); 
< UijQi^Sit = yes) = -CyesiAy" 1 + 1) Otherwise; 

Ui^h^s^t = no) = -CyesAy- 1 V s jit , s jit G {yes, no}, j ^ i,j G N(t). 
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where 



t-i 



{k : s i>k = yes, k = 1, 2, • • • , t - 1} 



where \A\ stands for the cardinality of a set A. 
To clarify more, in round t of the game, the channel is allocated to a user (a user wins 
the channel) if and only if he is the only one who plays yes in that round. In other cases 
no user wins the channel. 

Observation 1. As it is observed from the game specification, the users and information struc- 
ture are symmetric. Naturally, we are only interested in characterizing symmetric equilibriums 
of this game. 

III. Equilibrium: Characterization 

In this section we show that there is a unique symmetric subgame perfect equilibrium 
for the game described in Section UU We fully characterize it and show it is Markov 
■perfect as well, that is, the strategy of each user in each round t of the game depends 
only on the number of remaining users (n(t)), g(t), and the constants V, c yes . 
In the following we explain the notations and concepts we use along the paper. 

Notations: Consider a subgame beginning after history h*. E^[/i*, is the expected 
utility of user i,i e N(t), in this subgame and, E i)t [h*, n(t)\ {yes}] (E ijt [/i*, n(i)|{no}]) is 
the expected utility of user % in this subgame given that he plays yes (no) in round t. 
Each user at any time t chooses a strategy which is a map from any history of the game 
up to time t to [0, 1], a Bernoulli probability over {yes, no}. Let ptih 1 ), < Pt(/i*) < 1, be 
the probability of choosing yes after observing history h l of the game. 

The following theorem is the first main theorem of this paper. This theorem proves 
the existence and uniqueness of a Symmetric Subgame Perfect Equilibrium (SSPE) of 
the game specified in Section UU We further fully characterize the SSPE and show it is 
also Markov perfect. 
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Theorem 1 (The First Main Theorem). For the game specified in Section [III there is a 
symmetric subgame perfect equilibrium (SSPE) which has the following desirable properties: 

• Uniqueness, i.e., there is only one symmetric subgame perfect equilibrium. 

• Markov perfect, i.e., users' strategies in each round t of the game depend only on the state 
of the game in round t. 

• The SSPE is characterized as follows. In each round t,t e {1, 2, 3, • • ■ }, (after history h l ) 
of the game, each user i,i e N(t), purely randomizes over {yes, no] and chooses to play 
yes with the following probability 



p t (V,n(t),g(t),c yes ) = 1 - ^y^ry (1) 

In the rest of this section we prove this theorem. To prove the theorem, we first prove 
a set of Lemmas we need them along the proof of Theorem [H 

Lemma 2. In any subgame after h 1 , the expected utility of each user i,i e N(t), is upper- 
bounded by V ~ 9{ X) Cyea ■ 

Proof: The proof follows by the fact that the average utility of each user i, i e N(t), 
in any subgame beginning after h* is less than V ~ 9< f > {f) Cyea ■ * 

Lemma 3. There exits a > such that for any t,t e {1,2,...}, and any subgame after h l , 
Ptih*) > ol. 

Proof: Suppose there is not such a, i.e., for any a > there exists h* such that 
Ptih*) < a. Thus (pick a very small), for any i, i G N(t), we have 

Eu[h\n(t)\{yes}] > (1 - a) n ~\V - g(t) - c yes ) > - - 9 ®~ ° yes 

> K ht [h\n(t)] > E itt [h\n(t)\{no}}. (2) 

(a) follows since a is very small. 

Therefore, it is preferable for each user to always play {yes}, i.e., ptih 1 ) = 1, which is a 
contradiction. Thus, there exists a such that Pt(/i*) > a. ■ 
In the following lemma we prove an interesting property of the game proposed in 
Section [TTJ. We show in any symmetric subgame perfect equilibrium, after any history 
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h l , no matter how users have played up to round t, in round t of the game, all the n(t) 
users must purely randomize over {yes, no}, i.e., pt(/i*) G (0, 1), pt(h l ) ^ 0, 1. 

Lemma 4. Jn any symmetric subgame perfect equilibrium of the game, V£ G {1,2,3....}, and 
history h l which occurs with positive probability in equilibrium, ptih 1 ) G (0, 1), z'.e., p t (/i*) 7^ 
0,1. 

Proof: The proof has two parts. First, we show that pt(/i*) 7^ 0. We proceed by 
contradiction. Suppose after some history h l which occurs with positive probability in 
equilibrium each user i, i G N(t), plays no, i.e. pt(/i*) = 0. Then, we have: 

V — a(t) — r ( a ) 

E ht [h\n(t)\{yes}} = V - g(t) - c yes > 9{ yes > E i>t [h\n(t)\{no}}, 

n[t) 

the inequality (a) is correct by Lemma |2] 

In the second part of the proof we show that V7i*,t G {1,2,3,...}, where /i* is the 
history happened with positive probability in equilibrium, Ptih 1 ) 7^ 1. Notice that so 
far we have proved ptQ^) G (0, 1]. 

Again, we proceed by contradiction. Suppose pt(/i*) = 1, i.e., all users play yes. Thus, 
for any i,i G N(t), we have the following: 

E i , t [^*,n(t)|{no}] = J (3) 

and 

E ijt [h} ,n{t)\{yes}\ = -c yes + E ht+l [h t+1 , n(t)}, (4) 
now, there are two scenarios that can happen at t + 1: 

The first p t+ i(h t+1 ) G (0, 1) and the second p t+ i(h t+1 ) = 1, since we proved p t+ i(h t+1 ) > 
0. We analyze them, separately, in the following. 
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In the first scenario, since Pt+i(h t+1 ) £ (0, 1), thus user i, % £ N(t), should be indifferent 
between choosing yes and no, that is: 



Eu +1 [h t+ \n(t)} = E i)W [h* 1 MMves}]=^t+i[h*\n(t)\{no}] 

= Probjall the n(t) — 1 users play no\ E i>t+2 [h t+2 , n(t)] 

= [(l-p^^))^- 1 ]^^ 2 ^^)] (5) 

Equation (O) implies that 

E« +2 [ft' + > W ] = > »(*)]■ (6) 

In the second scenario p t+ i(h t+1 ) = 1, i.e., user i, % £ iV(t), strictly prefers to play yes. 
Thus 

E M+1 [/i m ,n(t)] = E M+1 [/i m ,n(t)|{ye S }] = -c yes + E M+2 [/i'+ 2 , n(t)] 

E t!t+1 [h t+1 in (t)} < E itt+2 [h t+2 ,n(t)\. (7) 

From the above two scenarios it concludes that a(k) = E ijt +k[h t+k , n(t)] is an increasing 
sequence, i.e. a(l) < a(2) < a(3).... 

Therefore, monotonicity together with boundedness (due to Lemma |2]) of {a(A;)} y!i . 6N 
should imply the convergence of the sequence. But, in the sequel, we show {a(/c)} /fc6N 
is not convergent that implies a contradiction and completes the proof of Lemma |H 

To show that {a(k)}keN is not convergent we only need to show: 

3e > 0, s.t. VM £ N, 3k such that k > M, and \a(k) - a(k + 1)| > e. 

For this matter, we pick e fixed and less than min |c yes , c yes ( 1 _ Q 1 ) W -i — 1 j (where a 
is as it is defined in Lemma |3]). Now, suppose that the second scenario happens at t + k. 
Then \a(k + 1) — a(k)\ = c yes > e (due to ©)• But, there is another situation that there 
may exist M £ N in which for any k > M second scenario does not happen, i.e., for 
any k > M, p t+k (h t+k ) £ (0, 1). This case can also be considered as follows. 



October 2010 



DRAFT 



8 



Since, as it is earlier assumed, for any k > M, p t+k (h t+k ) e (0, 1), and Pt+k{h t+k ) > a 
(due to Lemma |3]), then by employing (0) we have 



E ht+k [h t+ \n(t)] 



^ +fc (/ i * +fc ))^- 1 E i ,, +fc+1 [/ i * +fc+1 ,n(t)] 

E i!t+k [h t+k ,n{t)\ 



E ht+k+1 [h t+k+ \n(t)} = 
E i:t+k+1 [h t+k+ \n(t)] > 



(1 - pt+kih^))^- 1 
E i>t+k [h t+k ,n{t)} 



[(1 - a)^)" 1 ] 



(8) 



a(k + 1) — a(k) 



E, f+M \h ,+t + l ,n(t)] - E, !l+l [/j' +t , n (i)] 

> ^' r .!t )l -^r,-wi 



> 



(a) 

> C 



(1 - 

E M+fc [/i t+fc ,n(t)] 
(1 - a)^- 1 

E itt+k [h t+h ,n 

1 



E i>t+k [h t+k ,n{t)} 
1 

- 1 



yes 



L(l-a) 



n(t)-l 



(1 - 
- 1 



^ mill % Cy es ^ Cy G g 



> e. 



1 



(1 _ a )n(t)-l 



(9) 



where (a) is correct due to the fact that a(k) k€ ^ is monotone (thus E^ t+k [h t+k , n(t)] > 
E itt+1 [h t+1 , n(t)]) and (3). The above statement proves a(k) keN is not convergent. Thus 
the proof of Lemma |4] is complete. ■ 
Now, we are equipped enough to prove Theorem [H 

Proof of Theorem [D Consider a subgame beginning after h l with n(t) users. 
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Now, In round t, if user i, % G N(t), plays yes, then 
Ei.t^.n^Kj/es}] = -Cy^ + iV-gimi-ptih*))^- 1 

n(t)-l , . , _ v 

/c=i ^ ^ 

wherqll the first term corresponds to the payment of choosing yes, the second term 
corresponds to the event that user i wins the channel, i.e. the event in which user % is 
the only user who plays yes in round t and, the third term corresponds to the expected 
utility of user i from continuing after history h l , equivalently, more than one user play 

yes. 



Similarly, if user i, i e N(t), plays no, then 



E i;t [/i*, n(t)\{no}] = x Probjat least one user among n(t) users play yesj 

+Prob|all the n(t) users play noj E itt [h t+1 , n(t)] 
= (l-p t (h t )) n ®- 1 Eu[h t+ \n(t)] (12) 

where the first term corresponds to the event in which at least one user j,j ^ i,j e 
N(t), plays yes, thus, player % will be out for the rest of the game and, the second 
term corresponds to the event in which all the n{t) users play no, therefore, due to 
Assumption [TJ user i will remain in the game. 

But, by Lemma |H since at any SSPE, for any history of the game, pt(/i*) G (0, 1), 
therefore, user i,i e N(t), must be indifferent between choosing yes and no. That is, 
((10)) should be equal to (O, i-e., 

1 Notice that another way to write JlOb is as follows 

E i>t [h\n(t)\{yes}] = (V-flW-^JCl-ptCh'))"^- 1 

+ E ( nW fc " 1 )p t (^) fc (l-p t (ft t ))' l(t) ^[EM[ft t+1 ,n(i + l)]-c yes ] (11) 
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E i:t [h\n(t)\{yes}] = E i>t [h\n{t)\{no}} 
-c yes + (V- g(t))(l -p^tf))^- 1 + T m = (1 -ptWrV-'E^h^Mt)} 

= (1 - Pt (/ i m ))"W- 1 E M [/ i ' +2 ,n(t)] 



s-l 



](1 - Ptih**))"®- 1 



r=0 



lim 

s— >oo 



E ht [h t+S ,n(t)} 



s-l 



r=0 



(a) 



0. 



E lyt [h t+S ,n(t)] 
(13) 



where 



n(t)-l 



k=l 



n(t) - 1 
k 



and, (a) is correct since lim^^ [111=1 i 1 ~ i 1 ~ Pt(h t+r )) n =0. 



Equation (fT3)) implies that 

E iit [/i*,n(t)] = E^X^yes}] = E^ t [h\ n(t)\{no}} = 

n(t)-l 



fc=i 



Thus, E i)t [/i*,n(t)|{yes}] is simplified as follows: 



= E M [/i t ,n(t)|{ 2 /es}] = 

Equation ((14)) implies that 

p t (/i*) = 1 - »(*)■ 



+ (y-0(t))(l- ft (/»'))»M-i + Tm 



-c yes + (F -,?(*)) (l-p^)) 



tN\n(t)-l 



-yes 



V-g(t) 



Pt(V,n(t),g(t),c 



yes J 



Equation (|15|) also proves the SSPE is not only Unique but also it is Markovian. 



(14) 



(15) 
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Corollary 1. As another consequence of (pT3|> , at any subgame initiated after any history of the 
SSPE, the expected utility of each user is zero. A similar result also holds for the case with 
re-entry option. 

IV. Game: Set up with Re-entry Option 

In this section we analyze the game formulated in Section [IT] with re-entry option for 
users who play no. 

In the following theorem, similar to Section [TTTJ, we prove the existence and uniqueness 
of a symmetric subgame perfect equilibrium (SSPE). We further fully characterize the 
SSPE and show it is Markov perfect as well. 

Theorem 5 (The Second Main Theorem). For the game specified in Section |IF| with re- 
entry option for users, there is a symmetric subgame perfect equilibrium (SSPE) which has the 
following desirable properties: 

• Uniqueness, i.e., there is only one symmetric subgame perfect equilibrium. 

• Markov perfect, i.e., users' strategies in each round t of the game depend only on the state 
of the game in round t. 

• The SSPE is characterized as follows. In each round t,t e {1, 2, 3, • ■ ■ }, (after history h l ) 
of the game, each user i,i e N, purely randomizes over {yes, no} and chooses to play yes 
with the following probability 

Pt(V, 9 (t), c yes ) = 1 - ^ v C r g[t y (16) 

The proof of this theorem is, more or less, similar to the proof of Theorem [T] Thus, 
we only bring the sketch of the proof. 

Sketch of the proof: For simpilicity in arguments, we assume that n > 2. 
First, we present the following lemma which can be proved similar to Lemma |2] 

Lemma 6. In any subgame after h l , the expected utility of each user i,i e N, is upper-bounded 

fry v-g{t)-c V es 

Now, due the rules of the game specified in Section [Q] with the re-entry option for 
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users, we have for any i,i G N, and t, t G {1, 2, ...}: 

E^'lfoea}] = - Cy + (V-g(t))(l-p(h t )r- 1 + Y,[ k Jp(tf)*(l - pih^E^h^ 1 } 
*v[ti\{no}] (^'^pih^l-pih'))^ E ht+1 [h t+1 ] (17) 

where E i)t [/i*], E^j^Kyes}], E^/i*! {no}] are defined, respectively, similar to E i)t [/i*,n(£)], 
Eijlh*, n(t)\{yes}}, E iit [/i*, n(£)|{no}] (see Section HIT)). Notice that in the game with re- 
entry option for all t,t £ {1, 2, , ...}, n(t) = n (that is why n(t) is omitted). 

By similar argument we can show that Lemma [3] is also hold in the game with re- 
entry option. This implies that there exists an a > such that for any t,t G {1,2, ...}, 
p{h l ) > a, i.e., p(ti) G (0,1]. 

Next, we show that p(/i*) ^ 1. It is clear that in any round t, if p(h l ) = 1 then, for any 
i, % G iV, we must have 

E iit [^|{ye S }]>E M [^|{no}]. (18) 



But, substituting = 1 in ((17) gives 

Ei, t [/i*|{yes}] = -c y + E ht+l [h t+1 ], 
E M [/i*|{no}] = E ht+1 [h t+1 ] 

EitWiyes}] <E M [/i*| {no}], (19) 

which is in contradiction with (p~8]> . Hence, G (0,1), which implies that in each 

round t, t G {1,2,...}, of the game, each user i,i G N, should be indifferent between 
choosing yes and no. Equivalently, 

E i>t [h t \{ye8}]=E i)t [h t \{no}]. (20) 
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Thus, 



E iit [h t ]=E ht [h t \{yes}] = E M [tf| {no}] 



IK 1 -!", x ) 

r=0 



S+l] 



lim 

s— >oo 

0. 



n 



r=0 



n — 1 



p(/i m )(i-p(/i <+r )r 



E M+s+1 [/i'+ s+1 ] 
(21) 



Since lim^ [HU (l - (VM^X 1 - p(h t+r )) n ~ 2 )] = 0. Thus, Eq. (0 along with 
Eqs. (|20l) and (O imply that 



E M [^|{ye S }] = -c y + (V- g(t))(l - p(^)) n_1 = E M [^|{no}] = 0. (22) 



Therefore, 



Pt(V,y(t),c 2/es ) = 1 - 



-"yes 



V-g(t) 



(23) 



V. Revenue 

In the following theorem, we derive that the expected revenue of the network's owner 
in the game with re-entry. 

Theorem 7. Consider the the game specified in Section [TV] (the game with re-entry option). 
Then 

• (Part 1): The expected revenue of the network's owner is 



t 

where p k = 1 — 



t=i 



t-i 

n 

k=l 



n-1 



1 - 



np t 



npk(l — p^ 

1-(1- Pk )n~l\ yy^l - (1 - pt )n-l 



(24) 



V-g(k)- 

(Part 2): Assuming g(t) = 0, for any t,t e {1,2,...}, i.e., the value of wining the 



October 2010 



DRAFT 



14 



channel does not go down as time goes on, implies: 



REV = V. 



(25) 



Proof: (Proof of Part 1:) To prove this part we characterize each term of Eq. (|24|) as 
follows. 

The probability that the game ends in round t, given that round t is reached, is equal 
to 

np t (l -p t ) n ~ l 



l-(l-pt)"- 1 " 

Thus the probability that the game did not end before round t is 



t-i 

n 



k=l 



1 



np k (l -Pk) 



n-l 



i-(i-p k y-\ 

The expected number of users in round t of the game who play yes is 

Er=ir(9Pr(l-P*) w - r _ njH 

Prob(at least one user plays yes) 1 — (1 — pt)™" 1 

Equations ( |26| >-( |2"8j > complete the proof of Part 1. 

(Proof of Part 2): Setting g(t) = 0, implies that p t becomes independent of t, i.e., 



Pt = 1 - 

Now, substituting (f29l) in (|24|) gives: 



„-! c yes 



V 



REV 



s(*)=o 



E 



t=i 



-yes 



\-(\- v y 



1 - fl -vY- 1 1 ^ 



t-i 



n 



k=l 



np(l — p) n 1 

~ i - (i -py- 1 



j yes 



P) 



t=l 



np(l — p) 



n-l 



1 - (l-p) n ~ 1 _ 



t-l 



np 



^yes 



l-(l-p) 



n-l 



l-(l-p) n "V ^(l-p)"" 1 



V. 



(26) 



(27) 



(28) 



(29) 



(30) 



In the following theorem we derive the revenue of the network's owner for the game 
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without re-entry option when g(t) = for all t. 

Theorem 8. The revenue of the network's owner for the game specified in Section dl (the game 
without re-entry option) when g(t) = 0, for all t, is equl to V. 

Proof: When g(t), for all t, is zero, p t (see ((D) becomes stationary, i.e., independent 
of t. Further, due to corollary CO the expected utility of each user at any subgame of 
the SSPE is zero. Now, consider the whole game (which is itself a subgame). Each user 
wins the channel with probability - (due to the symmetry). Thus its expected value in 
the subgame is — . But, since the expected utility of each user is zero, then the expected 
payment of each user is also — . Therefore, the expected revenue of the network's owner 
is equal to n x ^ = V. ■ 

Remark 2. Notice that in the proposed game with and without re-entry option, when, for 
all t, g(t) is zero, i.e., the value of ruining the channel for a user does not change as time goes 
on, then the revenue of the network's owner 

• is independent of the number of users. 

• is equal to V. 

VI. Conclusion 

In this paper we proposed a new revenue maximizing dynamic game for allocating 
resources (e.g. channel) to strategic users. We characterized that for the proposed game 
(with and without re-entry option) there exists a symmetric subgame perfect equilib- 
rium, which is not only unique but also Markov perfect. We characterize the revenue of 
the network's owner for the proposed game. Further, we showed that when the value 
of wining the channel is always fixed and equal to V, i.e., the value of wining the 
channel does not decrease as time goes on, then independent of the number of users 
the revenue of the network's owner is maximized and it is equal to V in both cases 
with and without re-entry option. 
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